A Variational Formulation of Accelerated Optimization on Riemannian Manifolds
نویسندگان
چکیده
It was shown recently by Su et al. (2016) that Nesterov's accelerated gradient method for minimizing a smooth convex function $f$ can be thought of as the time discretization second-order ODE, and $f(x(t))$ converges to its optimal value at rate $\mathcal{O}(1/t^2)$ along any trajectory $x(t)$ this ODE. A variational formulation introduced in Wibisono which allowed convergence $\mathcal{O}(1/t^p)$, arbitrary $p>0$, normed vector spaces. This framework exploited Duruisseaux (2020) design efficient explicit algorithms symplectic optimization. In Alimisis (2020), ODE proposed continuous-time limit Riemannian algorithm, it objective solutions paper, we show on manifolds, also an considering family time-dependent Bregman Lagrangian Hamiltonian systems manifolds. generalizes results manifolds provides optimization An approach based time-invariance property Lagrangians Hamiltonians used construct very establish similar setting. One expects geometric numerical integrator is time-adaptive, symplectic, manifold preserving will yield class promising
منابع مشابه
Variational collision avoidance problems on Riemannian manifolds
In this article we introduce a variational approach to collision avoidance of multiple agents evolving on a Riemannian manifold and derive necessary conditions for extremals. The problem consists of finding non-intersecting trajectories of a given number of agents, among a set of admissible curves, to reach a specified configuration, based on minimizing an energy functional that depends on the ...
متن کاملOptimization Techniques on Riemannian Manifolds
The techniques and analysis presented in this paper provide new methods to solve optimization problems posed on Riemannian manifolds. A new point of view is offered for the solution of constrained optimization problems. Some classical optimization techniques on Euclidean space are generalized to Riemannian manifolds. Several algorithms are presented and their convergence properties are analyzed...
متن کاملA Geometry Preserving Kernel over Riemannian Manifolds
Abstract- Kernel trick and projection to tangent spaces are two choices for linearizing the data points lying on Riemannian manifolds. These approaches are used to provide the prerequisites for applying standard machine learning methods on Riemannian manifolds. Classical kernels implicitly project data to high dimensional feature space without considering the intrinsic geometry of data points. ...
متن کاملA Second Order Smooth Variational Principle on Riemannian Manifolds
We establish a second order smooth variational principle valid for functions defined on (possibly infinite-dimensional) Riemannian manifolds which are uniformly locally convex and have a strictly positive injectivity radius and bounded sectional curvature.
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: SIAM journal on mathematics of data science
سال: 2022
ISSN: ['2577-0187']
DOI: https://doi.org/10.1137/21m1395648